Papers with student model validation
Performance-Guided LLM Knowledge Distillation for Efficient Text Classification at Scale (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) face high computational demands at inference time due to high computational costs. |
| Approach: | They propose a cost-effective and high-throughput solution for large language models . PGKD distills the knowledge of LLMs into smaller, task-specific models based on teacher-student knowledge distillation . |
| Outcome: | PGKD outperforms BERT-based models and other knowledge distillation methods on multi-class classification datasets. |